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ABSTRACT Nt? l 

Statistical parameters of the phase-error behavior of a phase-locked 
loop tracking a constant frequency signal in the presence of additive, 
stationary, Gaussian noise are obtained by treating the problem as a 
continuous random walk with a sinusoidal restoring force. The Fokker- 
Planck or diffusion equation is obtained for a general loop. An exact 
expression for the steady-state phase-error distribution is available 
only for the first-order loop, but approximate and asymptotic expres- 
sions are derived for the second-order loop. Results are obtained also 
for the expected time to loss of lock and for the frequency of skipping 
cycles. Threshold criteria for the phase-locked loop are discussed, and 
thresholds of approximate models which have been widely accepted 
are obtained by comparison with the exact results available for the 
first-order loop. 


I. INTRODUCTION 


The phase-locked loop is a communication receiver 
which operates as a coherent detector by continuously 
correcting its local oscillator frequency according to a 
measurement of the phase error. A block diagram of the 
device is shown in Fig. 1 with the pertinent input and out- 
put signals indicated. The output of the voltage-controlled 
oscillator (VCO) is a sinusoid whose frequency is con- 
trolled by the input voltage e ( t ); that is, 

«*(*) = % = K*e(t) (1) 

so that when e ( t ) = 0, the oscillator frequency is o» 0 . The 
received signal is a sinusoid of power A 2 w, of arbitrary 



Fig. 1. Phase-locked loop 
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frequency o>, and of phase 0. Thus, it is represented by 
the expression 

(2)>* A sin [o)J 4- 0] = (2)** A sin [w 0 t + 0i (t)] 

where 

6 1 ( t ) = (a) — o>o) t ~b 0 (2) 

The noise is assumed to be stationary, Gaussian, and 
white of one-sided spectral density N 0 w/cps. The noise 
process over an arbitrary period of duration T can be 
expanded in a Fourier series whose coefficients become 
independent Gaussian variables in the limit as T ap- 
proaches infinity (Ref. 1). By collecting the sine and 

cosine terms of the series, we can represent the noise 

process of infinite duration by the expression 

n (t) — (2) % n t (t) sin (<at + 0) -h (2)^ n 2 ( t ) cos (wt + 0) 

where n x (t) and n 2 (t) are both stationary, white, Gaus- 
sian processes of one-sided spectral density N 0 w/cps and 
are statistically independent of one another. 

Thus the product of input and reference signals is 

2 {A sin [w 0 t + 0i (t)] + n x (t) sin (a >t + 0) 

+ n 2 ( t ) cos (wt + 0)} {K 3 cos [w 0 f + 0 2 ( t )]} 

= AK 3 sin [ 0 ! ( t ) — 0 2 (t)] 

+ K 3 n x (t) sin [(a> — a> 0 ) t -f 0 — 0 2 (t)] 

+ K 3 n 2 ( t ) cos [(a> — o>o) J + 0 — 02 (t)] 

+ double frequency terms 
= AK 3 sin [0! (f) — 0 2 (t) ] 

+ K 3 n! (f) sin [0! (t) — 0 2 ( t )] 

-f K 3 n 2 (t) cos [0! (t) — 0 2 (£)] 

+ double frequency terms 

where 8 X (t) is given by Eq. (2). The double frequency 
terms may be neglected since neither the filter nor the 
VCO will respond significantly to these for reasonably 
large <o 0 . Then from Fig. 1 we see that 

e (t) — K t F ( s ) { AK 3 sin [0! (t) — 0 2 ( t )] 

+ K 3 n x (t) sin [0 3 (t) - 0 2 ( t )] 

+ K 3 n 2 (t) cos [0! (t) - 0 2 ( t )]} (3) 

where F ( 5 ) is a rational function which represents in 
operational notation the effect of the linear filter in the 


loop. If we let (t) = 0i (t) — 0 2 (t) and K — K X K 2 K 3 
and use Eq. (1), we obtain 

4>(t) = 0 1 (t)-K 2 e(t) 

Then from Eq. (2) and (3) we have 

0 (t) = (o> — <t) 0 ) — KF ( s ) [A sin <j> (t) 

+ n x (t) sin <j> ( t ) + n 2 ( t ) cos </> (t)] (4) 

The instantaneous phase error or difference between 
the received signal and the reference signal at the output 
of the VCO is <f> (t). Equation (4) is the exact expression 
for the operation of the phase-locked loop in the pres- 
ence of noise. Several authors beginning with Gruen 
(Ref. 2) have obtained solutions of this equation in the 
absence of noise for a number of filter transfer functions 
and also for the case of linearly time-varying input fre- 
quency. The most complete treatment of the noise-free 
performance is contained in Ref. 3. The general case 
in which additive noise is present has been treated by 
a variety of approximations. Jaffe and Rechtin (Ref. 4) 
assumed <f> (t) to be at all times small enough that 
cos <}> — 1 and sin $ ^ </> < < 1 so that the expression in 
brackets in Eq. (4) becomes A<\> ( t ) + n 2 (t). This produces 
a linear time-invariant model of the system. Recently 
Van Trees (Ref. 5) refined this analysis by linearizing 
about the equilibrium point <j> 0 , making the assumption 

sin (<£ — 4> 0 ) ^ </> - </> 0 


This generates a linear time-varying model. Develet 
(Ref. 6) applied Booton’s quasi-linearization technique 
(Ref. 7), replacing the sinusoidal nonlinearity by its aver- 
age gain. Both Van Trees' and Devlet's methods obtain 
estimates of the noise threshold of the device. Margolis 
(Ref. 8) obtained a series representation for the moments 
of the phase error, but the method was too involved to 
give useful results. 

Unlike these analyses, continuous random walk or 
Fokker-Planck techniques yield exact expressions for the 
statistics of the random process Unfortunately, ex- 

pressions in closed form can be obtained only for the 
first-order loop (i.e., when the filter is omitted). For the 
general case, a partial differential equation in <f> and its 
time derivatives is derived, but solutions cannot be 
obtained in general. 

These techniques were first applied to this problem 
in the Soviet literature by Tikhonov (Ref. 9, 10), who 
obtained the steady-state probability distribution of <j> 
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for the first-order loop enclosed form and an approxi- 
mate expression for the distribution when the loop con- 
tains a one-stage RC filter. Tikhonovs result on the 
steady-state distribution for the first-order loop is con- 
tained in Part III of this Report. The variance and cumu- 
lative distribution are also obtained. In Part IV, we derive 
the Fokker-Planck equation for the general loop filter 
which produces zero mean error. In Part V, this equation 
is specialized to the second-order loop, and the form of 
the solution for the steady-state probability distribution 
of <j> is obtained. Part VI presents results on the mean 
time to loss of lock and the frequency of skipping cycles 


for the first-order loop, which is a random walk problem 
with absorbing boundaries. Finally, in Part VIII, the 
results are compared with those of the above mentioned 
approximate models in an attempt to determine validity 
thresholds for the models and a performance threshold 
for the device. 

First of all, in the next Part, a simple mechanical analog 
of the phase-locked loop is presented which provides a 
qualitative description of the operation of the device and 
an understanding of the nature of the statistical param- 
eters required for its quantitative description. 


II. THE FIRST-ORDER LOOP AND ITS MECHANICAL ANALOG 


If the filter is omitted, we let F (s) — 1 in Eq. (4) and 
obtain the first-order differential equation 

^ ( t ) = (ai — o) 0 ) — K [A sin <j> (t) 

+ fix (f) sin + n 2 (t) cos <j> (#)] (5) 

Hence the term "first-order” loop. Since «! ( t ) and n 2 ( t ) 
are both white, the instantaneous change in <f> represented 
by its derivative depends only on the present value of <f> 
and the present value of the noise. Hence </> ( t ) is a con- 
tinuous Markov process, permitting us to use random 
walk techniques to determine its probability distribu- 
tion. A mechanical analog is useful in understanding the 
mechanism of this "random walk.” Consider the pendu- 
lum of Fig. 2 consisting of a weightless ball attached 
by an infinitesimally thin, weightless rod to a fixed point, 
and let the apparatus be horizontal on a table top which 


is being randomly agitated. The pendulum is free to turn 
a full revolution about the point. Let the rod be initially 
at an angle <j> with respect to the vertical axis. Let an 
external force (such as a constant wind) be exerted on 
the ball in the vertical direction. Let the surface of the 
table be rough so that it produces a frictional force 
opposing motion of magnitude f<j>. In addition, let the 
ball be equipped with an internal engine which exerts 
a constant force F along the axis of motion. The random 
agitation of the table produces a force on the ball which 
may be represented by the two stationary, white, Gaus- 
sian processes of zero means n l ( t ) in the vertical direc- 
tion, and n 2 (t) in the horizontal direction. Then by 
equating forces along the instantaneous axis of motion, 
we obtain: 

f<j> + G sin <j> = F — nj ( t ) sin <j> — n* (t) cos <j> (6) 
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* 


If we divide by f and identify F/f with (*> — aj 0 ), G/f with 
AK, and l/f with K, we see that Eq. (6) is the same 
as Eq. (5). 



It is clear that in the absence of the random forces, 
the pendulum approaches the equilibrium position 

<j> o = sin -1 (F/G) = sin -1 (o> — w 0 )/(AK) (7) 


more than half a revolution so that it will tend to return 
to the equilibrium position after a full cycle of rotation 
in either direction. This corresponds to the reference 
signal of the phase-locked loop advancing or retreating 
one cycle relative to the received signal. The average 
time for this occurrence depends on the signal-to-noise 
ratio. Thus after a sufficiently long period, the probability 
density will appear as a multimodal function, each mode 
being centered about equilibrium positions spaced 2 tt rad 
apart, the central mode being the largest with each suc- 
cessive maximum progressively smaller. After an even 
longer period equal to several times the average time 
between revolutions, the central mode of the probability 
density will have diminished, the modes to either side 
will have become almost as large, and more modes of 
significant magnitude will have appeared. The central 
mode will remain the largest since the pendulum may 
have revolved in either direction with equal probability. 
Finally, in the steady state an arbitrary number of revo- 
lutions will have occurred. Then the probability density 
will be a periodic function (as will be proved in Part III). 
However, because the integral of the function must equal 
one at all times, the magnitude must be everywhere zero. 


at which point the velocity is zero. Because this is a 
first-order system, there can be no overshoot. If F > G 
or (<« — <i>o) > AK, there can be no equilibrium position, 
and the pendulum continues to revolve indefinitely 
which corresponds to a loop which can not achieve lock. 
When the random or noise forces are applied as well 
as the constant ones, the motion becomes a random walk, 
but when the noise variance is small, there is a strong 
tendency for the angle <j> to approach and remain about 
this equilibrium position. 

The complete statistical description of the random 
walk of the angle <j> is given by its probability density 
as a function of time, p ( <f>,t ). To understand qualitatively 
the behavior of this function, let us assume that the 
constant force F = 0 and that initially (at t = 0) the 
pendulum is at rest in the vertical position. Thus, 
p (</>,()) — 8 (</>). With the passage of time, the effect of 
the random forces will be felt in the movement of the 
pendulum from the equilibrium position. The qualitative 
behavior of the probability density function is sketched 
in Fig. 3. Of course, the condition 

p(<t>, #)<** = 1 

must always be met. After a sufficient amount of time, 
the random forces will push the pendulum around by 
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Fig. 3. Qualitative behavior of the probability density 
function for the first-order loop, a> = <o 0 


In the case for which F is not zero, or equivalently 
(o^wo, then clearly the pendulum will have a greater 
tendency to swing around in the sense corresponding 
to the direction of the force. Hence, the density function 
will not be symmetrical. In either case, we are 
lead to realize that the significant parameter, at least 
in the steady state, is the angle (or phase error) <f> modulo 
2 tt, since the number of revolutions of the pendulum 
which have occurred does not affect the present state 
of the system. In fact, although p (<j>, t) yields a complete 
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description of the statistical behavior, it would appear 
that a combination of the steady-state distribution of 
(f> modulo and the frequency or average time between 


revolutions would yield a simpler and equally valid rep- 
resentation. In the following Parts of this Report, these 
parameters will be obtained quantitatively. 


i 


III. THE STEADY-STATE PHASE-ERROR PROBABILITY DENSITY 
FOR THE FIRST-ORDER LOOP 


A continuous random walk which is a Markov process 
is described by the statistical parameters of the incre- 
mental change of position as a function of the present 
position. Thus from Eq. (5), in the infinitesimal increment 
of time At , the phase will change by an amount 1 


it follows that for a given position <f>, A <j> is a Gaussian 
variable with mean 

A<j> = [(<o — ft> 0 ) — AK sin <f>] At (8) 

and variance 


/ t+At 

<f> ( t ) dt = (w — wo) At — (AK sin <j>) At 

[ rt+At rt+At n 

sin <f> I n a (u) du + cos <f> j n2 (u) du J 

Thus, since n t ( t ) and n 2 (t) are white, Gaussian processes 
with 


n a ( u ) = n 2 (u) = 0 


and 


n x ( u ) n Y (v) = th ( u ) n 2 (t>) - (N 0 /2) 8 (u - v) 


~ ( A< A) 2 “ ( A <A) 2 

[ rt+At rt+At 

sin 2 $ I I ni (u) rh (v) du dv 

/ t+At rt+At “| 

I riz^nz^dudv \ 

- K 2 (N 0 /2) At 


(9) 


It is worth noting in passing that for the determination 
of p (<£* t), Eq. (9) shows that the two noise terms could 
be replaced by a single noise n'(f) of the same spectral 
density so that Eq. (5) could be rewritten 

( t ) = (w — ft) 0 ) — AK sin < p(t) — K n' (t) (10) 


1 This assumes that <p (t) is a continuous process, which is justified which is conveniently represented by the block diagram 

by physical considerations. of Fig. 4. The model can be shown trivially also to hold 
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for a higher order loop in which the filter is included 
after the amplifier. The VCO of Fig. 1 is replaced by an 
integrator and the multiplier by an adder and sinusoidal 
nonlinearity. This differs from the linearized model of 
Ref. 4 only in the inclusion of the sinusoidal nonlinearity. 


Although the equation is linear in p, the complete solu- 
tion for p(</>, t) is somewhat complicated by the non- 
linear behavior of the variable coefficients. 

However, the result of greatest interest is the steady 
state distribution 


p ($) = lim p (<j>, t) (13) 

t -* 00 


By definition, the steady-state distribution does not vary 
with time. Therefore, 

llm M4Jl = 0 (14) 

Fig. 4. Model of first-order loop ^ 



With the knowledge of the statistical parameters of 
the increment A</>, we may proceed to obtain p(<j>,t). It 
was shown by Uhlenbeck and Omstein (Ref. 11) and 
Wang and Uhlenbeck (Ref. 12) that for a continuous 
Markov process, the instantaneous probability density 
p(<t>,t) must satisfy the partial differential equation 


Thus in the steady state, the partial differential Eq. (12) 
reduces to an ordinary differential equation in p (<j>). 
Letting 

« = (4 A)/(KN n ) 


and 


fi = [4 (o> — <d 0 )]/(K 2 N 0 ) (15) 


djL ^ =-±[A(4,)p (*, t)] + | ^ [B <*) p <*, t)] we obtain from Eq. (12) 

^ ° = ^[ (aSin * _ ^ )p( * ) + ^] (16) 

with the lmtial condition 


V (£>0) — S (<j> — <f> o) 

where <f> 0 is the initial value of <j>, and where A (</>) and 
B (</>) are normalized moments of the infinitesimal incre- 
ment given by the following expressions: 

A (</>) = lim (l/At)A<j> 

o 

B (</>) = lim (1/At) <rl 0 

Ar -m) 


Equation ( 11 ) is known as the Fokker-Planck equation 
or the diffusion equation because it is essentially the same 
as the equation for heat diffusion. From Eq. ( 8 ) and (9) 
we obtain 


A (<f>) — (o> — <oo) — AK sin <f> 
B (</>) = K*N 0 /2 


If we integrate once with respect to </>, we obtain a 
first-order linear differential equation which is readily 
solved as 2 

p (<£) = C exp (a cos <j> + /3<j> ) 

1 + D I exp — (a cos x + fix) dx 

— 77 — </> — 7T (17) 

To evaluate the constants, we must utilize boundary con- 
ditions. First of all, as was pointed out in Part II, in the 
steady state we are interested in the distribution of 
<f> modulo 2 77 . Thus, one condition is: 

P(77) = p(-7r) (18) 

Secondly, since </> must lie between —77 and 77 and p (<f>) 
is a probability density, it follows that 



so that Eq. (11) becomes 

|jr = [(AK sin 4- o > 0 — ®) p] + ^ K 2 N 0 1— (12) 


^The results of Eq. (17) through (21) were first obtained by V. I. 
Tikhonov (Ref. 9). Actually, these are a special case of an expres- 
sion derived by Andronov, Pontryagin and Witt (Ref. 13) for a 
random walk problem with arbitrary nonlinear restoring forces. 
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(19) 


so that Eq. (22) becomes 

« - ( A*)/(N 0 B l ) 


(24) 


Using Eq. (18), we obtain 

D = exp(-2fa)-l (20) 

/ exp — (a cos x + fix) dx 

Then by means of Eq. (19), the constant C can be 
evaluated. 


which is the signal-to-noise ratio in the bandwidth of 
the loop. 

Equation (21) is plotted in Fig. 5 for several values 
of a. It resembles a Gaussian distribution for large signal- 
to-noise ratios, a, and becomes flat as a approaches zero. 
The asymptotic behavior of Eq. (21) for large a is of 
interest. Since for large a 


In the special case /? = 0 (which requires = a> 0 ; i.e., 
when the VCO quiescent frequency is exactly at the 
frequency of the incoming signal), from Eq. (20) we see 
that D ~ 0 and that when o» = a> 0 , the probability density 
becomes 


V (<#>) = 


exp (a cos <ft) 
2 »/„(«) 


(21) 


since 


C = 


/: 


1 

exp (a cos <t>) d<j> 


2tt 1(1 ( a ) 


The parameter a plays a very important role. From 
Eq. (15) we have 

a = m = _ (A 2 ) 

(KN 0 ) [N 0 (AK/4)] 

But A 2 is the received signal power, while AK/4 is an 
important parameter defined for the linearized model 
of the loop (Ref. 4). If we replace the sinusoidal non- 
linearity in the model of Fig. 4 by its gain A about <j> = 0, 
we obtain the linearized model. Then the variance of <j> 
is obtained by using Parseval’s theorem as: 

, _ 1 f"N 0 gV or 

2tt ]. m 2 1 + (A*IP/«*) N «( AK / 4 ) 

The variance of <j> is the same as the noise power at the 
output of an ideal low-pass filter of bandwidth AK/4 
when the input is white noise of one-sided spectral 
density No- Hence, for the first-order filter, the loop band- 
width is defined as 

B l = AK/4 (23) 


Io (a) ~ (exp a)/(2ira)* 

n / , v _ [exp (q cos $)] (exp [« (cos ± - 1)] ) 

PW [2ir/o («)] (&/«)* 



-0.8-r -0.4-r 0 0.4ir 0.8 -r 

, rad 


Fig. 5. First-order loop, steady-state probability 
densities for w = 
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Expanding cos <j> in a Taylor series, we obtain 


The variance of </> can be similarly obtained. 


P(<t>) 


exp 


-_*£( 

2_V 


2^ 2^ . 
1 4! + 6! 


)] 


(27 t / a)^ 


(25) 


— 7T — </> - 


*-L 


<f> 2 exp (a cos <j>) d<j> 


= Tl/ ( a J <t> 2 (“) + 2 2 In (a) cos n</>" j d<j> 


When a is large, p (</>) decays rapidly so that the function 
is very small for all but very small values of <j>. Thus the 
higher order terms of the series representation of cos <j> 
have very little effect for moderate values of p (<£). Hence 
the graph of p (</>) will appear to be nearly Gaussian for 
large a, and in this case, the results of the linear model 
are quite accurate. 


The cumulative steady-state probability distribution 


7 T 2 

3 


00 


+ 4 2 

n = 1 


(-l)-i„( a ) 

n 2 7 0 (a) 


(27) 


This series converges even more rapidly than that of 
Eq. (26). It was computed manually and is plotted in 
Fig. 7 as a function of 1/a. Note that as the SNR a 
approaches zero, the variance approaches 7r 2 /3 which is 
the variance of a random variable that is uniformly dis- 
tributed from — 7T to + 7 r. 


P(|*| <</> o) = 



0 < <£o < 7T 


is also of interest since it indicates the percentage of 
time during which the absolute value of the loop phase 
error <j> is less than a given magnitude <£ 0 . This may be 
calculated when w = o> 0 in the following manner. Expand- 
ing p (<f>) of Eq. (21) in a Fourier series, we have 


P(<t>) = 


exp (a cos <j>) 

2ttIo (a) 


1 

27t/o (a) 



+ 2 2 In (a) COS TUj> 


Then 


ft* 

^(|0| < </>o) — 2 J o P(<j>)d(<t>) 


<f> o ^2 ^ In ( g ) sin n<t> 0 

7T 7T n=l n./ 0 ( a ) 


0 < </>o 7T f° r <*> — <*>0 


(26) 


This series converges rapidly so that Eq. (26) could be 
calculated for several values of a without the use of a 
large-scale digital computer. The results are shown in 
Fig. 6. 


For the general case (o>^=o) 0 ), Eq. (17), (19), and (20) 
yield the entire distribution. However, analog or digital 
computation is required to evaluate the pertinent inte- 
grals. The case for which (P/a) = (<o — m 0 )/(AK) = sin (tt/4) 
is shown in Fig. 8. The constants as well as the distribu- 
tion were obtained by means of the analog computer. 



Fig. 6. Steady-state, cumulative probability distribution 
of first-order loop for a> = <t> 0 


8 



rod 










JPL TECHNICAL REPORT NO. 32-427 


IV. THE FOKKER-PLANCK EQUATION FOR HIGHER-ORDER LOOPS 


Consider the phase-locked loop whose filter has the 
rational transfer function 

F (s) = G (s)/H (s) 

where G (s) and H($) are polynomials such that G (0) = 1, 
H (0) = 0 

deg G (s) — deg H (s) = n — 1 

then 

G (s) = 2 o 0 # 0 

fc = 0 

(28) 

H(s)= SW b„-.#0 

k = i 

This will be referred to as an nth-order loop. In this case, 
Eq. (4) which describes the operation of the loop becomes 

sH ( s ) </> = — KG ( 5 ) [(A + n,) sin -b fi* cos </>] (29) 


n - 2 / n~l \ 

hn-jXn-,-1- 2 b k x k ^ 1 - — K (A + rij) sin ( 2 a*** ) 
k = l L \fc=o / 


+ n 2 cos | 


Also, we have 


x k = 


dt dt k 


~ = **-i 


so that we may express the derivatives x* in terms of the 
variables x* by the n differential equations 

* __y_^ & 

£n-l ^ U Xfc + i , 

* = l U n - i £>n-l 

X £(A + m) sin (2 a***) + n, cos ( 2 ak*k)J 


x n - 2 ^r? - 


since 


s* (o> — o> 0 ) = ^ (o) — (i> 0 ) =0 for fc : 


Xo = X, 


(33) 


The reason for the pole at the origin of F ($) is now 
clear. It eliminates the constant (<d — o) 0 ) which causes 
the steady-state phase error in the first-order loop. Now 
let us define the random variable c by the relation 3 

4> = G(s)e (30) 

Inserting this in Eq. (29), we obtain 

sH(s)e= -K{[A + n,] sin [G (s)*]+ n 2 cos [G (s) e]} 

(31) 

which is an nth-order differential equation. Now let us 
define the n random variables x 0 , Xi, * * * , x w as 


It follows also from Eq. (28), (30), and (32) that 

<f> = 2 0*$* (34) 

fc = o 

The random vector (x 0 , * • • , x n -i) is a Markov vector 
since an incremental change depends only on the present 
state of the vector. 

Wang and Uhlenbeck (Ref. 12) have shown that for 
a vector Markov process x = (x 0 , x l9 • • • , x n _i), the 
Fokker-Planck equation is 


Xk ^~dF k = 0, 1, • • • , n — 1 (32) 

where 

Inserting these for the derivatives of e in Eq. (31) and 
by using Eq. (28), we obtain 

and 

^his substitution which leads to the representation of <f> as the 
sum of the components of a Markov vector (Eq. 33) was suggested 
by J. N. Franklin. 


+ £ 2 


d 2 


2 k=o i.o dx k dxi 


[B k l (x) P (x)] 


A k (x) = lim (Ax fc ) 

Afloat 


B k i (x) = lim — (Ax k ) (A Xi) 

A/~m> At 


(35) 


lO 
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with the initial condition 


P (x, 0) = n S(x k -x k<0 ) 

k = 0 

A* (x) = x fc+1 for k — 0,1, • • ,n- 2 


Thus, the Fokker-Planck equation for the nth-order 
loop is 

0P(*,*) = _v_ aPfeO . _L_ 

0# *To^ +1 0** bn-10X„-, 


A„-i(x) = - 


« — 2 


2 


*=i 




KA W_1 

— sin 2 0*** 

B»-l fc = 0 


Bn-i,n-l(x) = lim ^7^- 
At->o Ar 0»-i 


[ Tf+Af rf+Af 

sin 2 <f,l I n 1 (u)n 1 (v)dudv 

/ t+A t ft + At "I 

I (u) Th (o) du do I 


K 2 N 0 /2 


B fc , i (x) = 0 for all fc ^ n — 1 and n — 1 


X 


( 2 hk^ + , + KA sin 2 a*x*)P(x,t) 1 

L\*=o *=o / J 


K 2 N» 8 2 P(x,t) 
h 4&S-, 3x5. x 


(36) 


where 


»-l 


^ = 2 «*** 

fc = o 


Solution of this general case does not appear possible. 
However, in the next Section some results are obtained 
for the second-order loop. 
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V. STEADY-STATE PROBABILITY DISTRIBUTION FOR THE SECOND-ORDER LOOP 


The loop filter of greatest interest 4 is 

F (s) = 1 + (a/s) = (s + a)/(s) 

which requires a single integrator with gain a. In terms 
of the parameters of Eq. (28), n = 2, a 0 = a, a 1 — 1, 
hi = 1. Substituting these parameters in Eq. (33) and 
(36), we obtain the differential equations for the random 
variables 

i x = — K [(A + n/) sin ( ax 0 + x x )] — Kn 2 cos ( ax 0 + Xi) 

(37) 

X 0 = X 1 

and the Fokker-Planck equation 


JdP , dP\ A „d , . fP * . K 2 N 0 d 2 P 

a( * - + fcj = AK tf (sm * F) + — 5? 

(41) 

Even this partial differential equation cannot be solved 
directly. However, since we are interested only in the 
distribution of </> 



we may integrate both sides of Eq. (41) with respect to z 
over the infinite line and obtain an ordinary differential 
equation in p (<j>) 


dP 3 TlAir • / K 2 N C , d 2 P 

+ ^ [{AK sin {aXn + Xi)p] + ~Tm 

(38) 

where 

< f > ~ ax o 4- X! 

If we restrict our attention to the steady-state probability 
distribution 

P(x 0 ,x 1 ) = lim P (x 0 , x 1? t) 


since 


lim ^ (x 0 ,x u t) = 0 


we obtain 


dP A „ d r • , , * , K 2 N o d 2 P 

*■ & = AK s; 1 Is,n <“• + *•> p > + — w 


With the substitutions 


(39) 


“ /df “ 3* [/. 2 j p <4. 2 > *]} = AK ft (sin + p) 


KW„ rf 2 p 
4 d<p 2 


(42) 


But 

/ oo r x 

z P (<£, z)dz ~ p (<j>) / zP (z\<j>) dz — p ((/>) E (z \ <f>) 

00 J -oo 

so that Eq. (42) becomes 

° = ^ j[AK sin — a<f> + aE (z| *)] p 4- 

(43) 

Unfortunately, it is not possible to determine exactly 
E (z | </>), which is a function of <£, without knowing 
P(z,<l > ), which would require solution of Eq. (41). How- 
ever, its general form can be obtained as follows: from 
Eq. (40) we have z = </> — x x so that 


= ax 0 + x, 

(40) 

z = ax o 

we obtain an equation in P ( <j> , z) (note that the Jacobian 
of the transformation is a) 


“Tikhonov (Ref. 10) considered the RC low-pass filter whose trans- 
fer function is 1/(5 + b). Its value is questionable, however, since 
it does not reduce the mean phase error to zero, as the perfect 
integrator does. 


E[* (*)!*(*)] =E[<t>(t) ~x.it ) | *(*)] (44) 

— 4>(t) — E [*! (t) 1 4> (t)] 
Integrating Eq. (37) using Eq. (40), we have 

*! ( oo ) — x 1 (t)= —AK J' sin <j> (£) d£ 

~ K J t (i) sin <j> (£) dg — «2 (!) cos <f> (|) d£ 
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Since the noise is white, n a ( t ) and n 2 (t ) are independent 
of <f> ( t ) for all t so that, since ihJt) = n 2 ( t ) = 0, the ex- 
pectations of the noise terms are zero. Also 


where p ^ (r) is the normalized autocorrelation function 
of the stationary process <j> ( t ). The integral can be ob- 
tained by using Parseval’s theorem: 


£Moo)|*(f)] =E[* 1 (oo)]=0 

since it is clear that the mean of the process is zero. 
Therefore, 

E [ Xl (t) | 4 , (#) ] = AK f t " E [sin * ({) | <j> (#)] di 

(45) 

This is the integral of the expectation of sin <f> over the 
entire past history of the process given the present value 
of <j>. Combining Eq. (43), (44), and (45), and letting 
£ = t + r, we obtain 

0 = 5 {£k ( sin * - “ i E [•!«♦(* + .) I ♦ (*)]*) 


where R*(r) is the unnormalized autocorrelation func- 
tion, a 2 the variance of </>, and S* (<*>) the spectral density. 
Since we have approximated sin <j> by <f>, we may use 
the linearized version of Fig. 4 with the loop filter 
F (s) — [1 + (a/s)] inserted. Then 

c / \ — No* 2 s + a I 2 

* w 2 s 2 + AKs + aAK \ 

so that S*(0) = (N o )/(2A 2 ). 
and 


The magnitude of the expectation is always less than 
one and becomes negligible for values of r several times 
the inverse bandwidth of the spectrum of <j>(t). This 
bandwidth is proportional to AK, as we found for the 
first-order loop. Therefore, the order of magnitude of 
the integral is inversely proportional to AK, and if 
a < < AK, the second term in the coefficient of p (<f>) is 
much smaller than the first. Neglecting this second term 
reduces Eq. 46 to the steady-state Fokker-PIanck equa- 
tion for the first-order loop (Eq. 16) with « = o> 0 , whose 
solution is Eq. (21). Thus when the second integrator 
gain a < < AK, 

< 47 > 


j o p,(r)dr=l/(AK + a) 

Inserting this integral in Eq. (48) and substituting in 
Eq. (46), we obtain 

whose solution with the boundary conditions of Eq. (18) 
and (19) is 

V (</>) — for lar 8 e ( 49 ) 


On the other hand, for any value of a when the SNR 
is large enough, <j> ( t ) will be small for all time so that 
sin <f>(t) ~<f> ( t ) and both $ (f) and sin <j> ( t ) will be nearly 
Gaussian processes. In this case, the expectation can be 
approximated by 

E [sin <j> (t H- t) | <j> (t)] dr —^J ( T ) dr Jsin 

(48) 


where the effective SNR, a', is given by 
a ~ (A 2 )/[N 0 (AK + a)/(4)] 

If we let B l — (AK + a)/ 4, this is the same expression 

as that for the first-order loop with <t> a)(). As would be 

expected, this expression for loop bandwidth for the 
second-order loop is that obtained from the linear model 
of the loop. 
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VI. MEAN TIME TO LOSS OF LOCK AND FREQUENCY OF SKIPPING CYCLES 


Since we have obtained only solutions for steady-state 
probabilities, a valuable statistic is the expected time 
required for the absolute value of the phase error to 
exceed some value <f>i when it is initially zero. When 
this occurs, the loop will be said to have lost lock. Of 
particular interest is the case for which = ±:2ir y which 
represents a loss or gain of a complete cycle, or for 
the mechanical analog, a complete revolution of the 
pendulum. 

We only treat the case of the first-order loop for which 
the received frequency o> equals the VCO quiescent fre- 
quency o>o so that <j> = 0 is the equilibrium position. This 
is also a good approximation to the steady-state behavior 
of the second-order loop with any value of ili — 0>o but 
with very small integrator gain a, as will be discussed 
later in this Part. For the first-order loop, when ^ w 0 , 
the same approach can be used measuring phase error 
from the equilibrium position rather than from zero, but 
the results are in the form of integrals which require 
numerical calculation. 

Returning to the mechanical analog of the pendulum 
of Part II, we treat the motion of the ball by the oper- 
ational equation 


Thus we have the boundary conditions 5 

p (-</>!,*)= 0 (51) 

Solution of Eq. (50) over the interval ~<f>i < <t> < 4>i 
with the boundary conditions of Eq. (51) would yield the 
probability density p(<£,f). Its integral over the interval 

*(*)= / P(+,*)<b (52) 

J-<h 

gives the probability that <j> has not yet reached <f>i at 
time t . Then the probability density of the time when 
\<t>\ reaches <j>i is — [di// (t)]/(dt). Thus the expected time 
to reach the out-of-lock position <f>i is 

(53) 

Since with probability 1, | <j> | must reach <j>i before t = oo , 
then ^ ( oo ) = 0 so that the combination of Eq. (52) and 
(53) yields the mean time to lose lock 

n *i 

p (<j> y t) d<f>dt (54) 

<h 


<f> — — AKsin<j> — Kriisin<£ —Kn 2 cos4> 


Now if we integrate both sides of Eq. (50) with respect 
to t over the infinite interval, we obtain 


as long as |^|<</> z . But when the pendulum angle <f> 
reaches ±<j>i y we assume that it is grasped by a demon 
and removed from operation forever after. We seek the 
average time for this event to occur when the pendulum 
is initially at rest at <f> = 0. As long as 1 <f> | < <£i, the proba- 
bility density of <f> is described in the same manner as 
before by the Fokker-Planck equation 


V (*, cc ) - p (*, 0) = ^ (AK sin * P) + ^ 


where 


(55) 


P(4>) = J o p(<t>,t)dt 


t = 'k {AKsin + p) + 


N 0 K 2 9 2 p 
4 0<£ 2 


As we noted previously, p (<£, oo ) = 0, and since <f> is 
assumed initially at zero, p (</>, 0) — 8 (<f>). Therefore, 
we have 


p (</>, 0) = 8 (<f>) for \ <{>\< <f>i (50) 

However, as soon as \<j>\ reaches <j>i for the first time, 
the pendulum is removed from action so that 

p(<M) — 0 for all 


-8 (</,) = ^[AKsin^P W] + N f (56) 


5 The solution of the so-called first passage time problem by means 
of the Fokker-Planck equation with absorbing boundaries was first 
treated by Siegert (Ref. 14). 
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which may be solved using the boundary conditions 


P ( <t>i ) — J P ( </>(> t) dt — 0 

(57) 

P(-<h) = J o p(—<l>i,t)dt = 0 

The solution to Eq. (56) may then be integrated with 
respect to <j> over the interval — </>*, <j>i to obtain T, the 
expected time to lose lock of Eq. (54). Taking the indefi- 
nite integral of both sides of Eq. (56), we obtain 


C -Ufa) = AK sin 4>P(4>) + ^^^^- (58) 

where C is a constant to be evaluated from the boundary 
conditions. The solution to the first-order differential 
equation is 

P(<j>) = D exp (a cos <j>) 

+ exp (a cos <f>) f — a CQS [C — u (x)] dx 

J "fi y 

(59) 

where 

A 2 

“ N 0 (AK/4) 

and 

_ N 0 K* _ AK _ 4B l 


The domain of integration is the right isosceles triangle 
shown in Fig. 9. We can obtain a series representation 
of this double integral by expanding the integrands in 
Fourier series 

00 

exp (a COS <j>) = I 0 (a) + 2 2 -bn (a) cos m <f> 


(62) 


exp ( — a cos x) = /o (a) + 2 2 ( — 1)" In (a) cos nx 



Fig. 9. Domain of integral T 


Applying the boundary conditions of Eq. (57) yields the 
values of the constants as D = 0 and C = 1/2. Then 


Thus 

p (<t>) = ex P ( a ^ cos & j*' exp ( -a cos x)[| - u (x)] dx 

(60) 

and integrating with respect to <f> over the interval 
[ — we obtain an expression for the mean time 

to lose lock 

t= r , p(<t>)d<i>=±r , d<i> 

J+i y J-fi 

X exp a (cos </> — cos x) u ( x )^j dx 

1 [+> r*i 

= - I I exp a (cos d> — cos x) dx d<t> (61) 

y Jo Jf 


T = 


1 

y Jo J* 


X 


II (a) + 4/ 0 («) 2 ( - 1)" In (a) COS ruf, 

fl = 2, 4, 6, • • • 

+ 42 2 - (l) n J m (a)I„(a)cos«i4>cosnx 
1» = 1 »= 1 


d<£dx 


= -f f ° (”)^ - + 4/ 0 («) 2 %^sin2n^ 

y |_ 2 w = i 


+ 4 2 2 (-l)»M«)l.(«) 


x 


n: 


cos nuf> cos nxdxd<j> 


] 
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where 
r<h r*i 

J J cos m<t> cos nxdxcbj) = 

! cos (n — m) 6i \ — — H 7 — - 7 

v /r [_nm n(n-m) J 

4cosnj>; 1 

nm (n — m) n 

( _1 cos m<ft A 

m 2 m 2 / when n — m (63) 

This expression may be computed without the aid of a 
large-scale digital computer because the sequence Z„ (a), 
and consequently the above series, converges quite 
rapidly. 

However, the most important result which we seek 
can be obtained in closed form. This is the frequency 
of skipping cycles, or, in other words, the inverse of 
the expected time between skipping cycles, which is 
T (<j>i = 2? r). It is clear from Eq. (63) that when <f>i = 2tt 

= (64) 

where we have used 

_ N„K- _ AK _ 4 B l 

so that 



Fig. 10. Frequency of skipping cycles normalized by loop 
bandwidth for first-order loop where a> = <o 0 


when n^m 


frequency of skipping cycles = (2B l )/[tt 2 al% («)] (65) 

This parameter normalized by B L is shown as a function 
of a in Fig. 10. 

For large SNR, «, 

lo («) ~ (e a )/(2r7ra)K 

so that 

frequency of skipping cycles ~ [(4 B l )/tt] e~ 2a (66) 
for large a. 


In the mechanical analog this corresponds to the pendu- 
lum arriving at the unstable equilibrium position and 
returning to the stable equilibrium position, either by 
the same route or by going around the full revolution. 
It is nearly intuitive that for a Markov process the fre- 
quency of this event is exactly double the frequency of 
skipping cycles. However, to show this rigorously, we 
note that the expected time for the pendulum to go from 
the equilibrium position </> = 0 to </> = tt and to return 
is T (?r) + V (tt), where T (tt) is the expected time to go 
from 0 to ±tt and V (tt) is the expected time to go from 
7 r to either 0 or 2 t r. T (?r) is given by Eq. (61) with <f>i = tt, 
while we can show that 


Another parameter which is equally significant is the 
frequency of dropping or advancing half cycles (<f>i = tt). 


I r*i f<t> 

V (tt) — - / / exp a (cos <j> — cos x) dx d<j> 

y Jo Jo 
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The integrand is the same as that for T (tt), but the 
domain of integration is its complement with respect to 
the square of side 7 r (Fig. 11). Therefore, 


T (7 r) + V (?r) = — / / exp a (COS <j> ~ COS x) dx d<f) 
y Jo Jo 

= (*7r )«(«) = [T(&r)/2] (67) 

and 


frequency of skipping half-cycles = (4 B l )/[tt 2 all («)] 

( 68 ) 

We can show that these results are approximately cor- 
rect also for the second-order loop when a is large or 
a < < 1 by means of the arguments used in Part V to 
obtain Eq. (43) through (49). 


Fig. 1 1 . Domains of integration for T b) and V ( 77 ) 



VII. THRESHOLD CONSIDERATIONS AND CONCLUSIONS 


By means of the approximate models discussed in 
Part I, Van Trees (Ref. 5) and Develet (Ref. 6) have 
attempted to determine the threshold of the phase-locked 
loop; the threshold, as they define it, is the value of SNR 
for which the variance of the phase error becomes un- 
bounded. However, we have shown by an exact analysis 
that the variance of the steady-state error is always 
bounded by the variance of the rectangular distribution 
p (<j>) = (1/2? r) for — 7T < <£ < 7T, which equals (tt 2 /3). 
This is due to the fact that phase is measured to the 
nearest cycle (i.e., modulo 2 tt). On the other hand, if we 
count a change of a full cycle of phase as a phase error 


of 2?r, and consider the resulting distribution and its 
variance, we find that the variance is unbounded for 
all noise densities greater than zero, for with this premise, 
the steady-state probability density has been shown to 
be a periodic function, so that its variance is necessarily 
unbounded. In simple physical terms, for any nonzero 
noise power, if the noise has a Gaussian distribution 
with probability one the loop will gain or lose a cycle 
if enough time elapses. (For the first-order loop, the ex- 
pected time was obtained exactly in Eq. 64). Therefore, 
in the steady state (i.e., after an infinite interval of time 
has elapsed), the number of cycles skipped has a flat 
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probability distribution; hence the probability density 
function is periodic. Since the idea of infinite variance 
for all finite SNR is ridiculous, we have no alternative 
but to accept the concept that phase is meaningful only 
modulo 2 tt, so that the variance is never unbounded. The 
mechanical analog of the simple pendulum discussed in 
Part II is useful in visualizing these conclusions. 

If we redefine threshold to mean that value of SNR 
for which the linear model, or some other approximate 
model, becomes inadequate for the analysis, then our 
foregoing results can be utilized to determine the thresh- 
old of the model. It has been shown that, for a first-order 
loop with no frequency offset, the steady-state phase 
error has probability density 


p (<t>) = 


exp (a cos <f>) 
2 :rZo (a) 


— 77 — <f>^= 7 r 


where a = (A 2 )/(N 0 B L ) and that this is approximately 
correct also for a second-order loop with small integrator 
gain. Also, we have shown that the variance of <j> in 
this case is given by 



>7 — 1 ft" I() («) 


(69) 


This is shown in Fig. 12 as a function of 1 /a — B L /A 2 , 

where it is compared with the variance obtained from 
the linear model which is simply 


<4 = l (Linear) (70) 

Also shown in Fig. 12 are the results using the approxi- 
mate models of Van Trees and Develet. Van Trees 
(Ref. 5) shows that for the first-order loop with no fre- 
quency offset (in our terminology) 

ai = — — r (Van Trees) (71) 

so that the model yields an unbounded variance at 
a — 1. Develet (Ref. 6) used the quasi-linearization tech- 
nique of Booton (Ref. 7) which replaces the sinusoidal 
nonlinearity of Fig. 4 by its average gain, assuming that 
the input distribution is nearly Gaussian. The gain of a 
sinusoidal nonlinearity for an input of value x is A cos x. 
Therefore, the average gain when the input is Gaussian 
of mean zero and variance <r is 



A 


cos x exp 



dx = A exp 




l/a ={N q B l )/{A z ) 


Fig. 12. Comparison of variance for first-order loop 
with results of approximate models 


Replacing the nonlinear element of Fig. 4 by this gain, 
we obtain, by the usual linear analysis, the variance of the 
phase error for the first-order loop: 

<r- = (l/«) exp (a-/ 2) (Develet) (72) 

The solution of this transcendental equation yields the 
value of the variance which is also shown in Fig. 12. 
The maximum of <r 2 exp — (<r 2 /2) is 2/e so that there 
can be no solution for « < e/2. This is the point of un- 
bounded variance for Develet’s model. 


In Fig. 12 we see that for SNR = a > 1, the linear 
model always yields an underestimate while Van Trees' 
result is always an overestimate of the variance of the 
phase error, as might be expected from the nature of 
the approximations. With the linear model the error 
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in the approximation is less than 20% as long as 
[(N 0 B l )/A 2 ] < 1/4, or a > 4 which is a figure often 
quoted by experimenters as a threshold of the linear 
model. Develet’s model yields by far the most accurate 
result. In fact, it differs from the exact result by less 
than 10% for [(N 0 B L )/A 2 ] < 0.65, or a > 1.54. Thus it 
would appear that if the exact solution cannot be ob- 
tained, as is the case for higher order loops, colored 
noise, or a modulated carrier, the Booton quasi-linearized 
model would yield quite accurate results when the SNR 
in the loop bandwidth is above 1.5. 

The other significant result of this Report, which can 
be used to define threshold, is the frequency of skipping 
cycles. It was shown in Part VI that for a first-order loop 
with no frequency offset or a second-order loop with very 
small integrator gain, the 

frequency of skipping cycles == (2B L )/[ir~ali (a)] 

which is plotted in Fig. 10. Thus we might set the thresh- 
old of the system as the SNR below which the frequency 
of skipping cycles exceeds a given value. Thus, for ex- 
ample, let B l = 20 cps and the maximum allowable fre- 
quency of skipping cycles be once every minute. Then 
we see from Fig. 10 that the threshold of the system is 
at a = 3.6. Note, however, that when the system operates 
at a = 7.2, 3 db above threshold, the frequency of skip- 
ping cycles drops to once every 20 hr reflecting the 
exponential behavior of this expression. This definition 
of threshold is most significant for coherent tracking 
applications wherein the doppler frequency is measured 
and integrated to obtain relative range information. Loss 
or gain of a cycle will yield incorrect results. 

A third definition of threshold is the SNR for which 
the absolute value of the loop phase error \<j>\ exceeds 


a given value <j> tt exactly half the time. For the first-order 
loop with co — a>o, this information is available from the 
cumulative probability distribution of Fig. 6. For exam- 
ple, if we set <f> 0 at tt/4 rad, we find from Fig. 6 that the 
SNR at which \<f>\ exceeds this value exactly half the 
time is a = 1.1. We see also that when the SNR is 3 db 
above this threshold level (i.e., a — 2.2), then | <f> | exceeds 
tt/4 rad only about three-tenths of the time. 

It is felt that the third definition of threshold has the 
least significance. The definition in terms of skipping 
cycles is most meaningful for ranging and tracking appli- 
cations. However, the most useful result is the determina- 
tion of the threshold of validity of the various models of 
the phase-locked loop. By comparing the variance of the 
phase error computed from each of the models with the 
actual variance for the first-order loop, which is the only 
case for which an exact solution in closed form is avail- 
able, we have been able to determine these validity 
thresholds. The linear model underestimates the variance 
by less than 20%, for SNR > 4(6db). Van Trees’ model 
overestimates <r 2 to within this accuracy for SNR > 2.5 
(4 db), while Develet’s model is accurate to within 10% 
for SNR >1.54 (1.7 db). It does not necessarily follow 
that each model will yield equal accuracy for more com- 
plicated loops or signals, but these figures do represent 
lower bounds on the over-all validity. They also provide 
a ranking on the merits of the three models. It appears 
that the simpler the expression for variance, the less 
accurate is the result. If we wish merely to obtain bounds 
on performance, the results of Fig. 12 suggest that we 
use the linear model as an upper bound and Van Trees’ 
model as a lower bound. On the other hand, if we are 
willing to solve a transcendental equation of the type 
of Eq. (69), it appears that Develet’s model produces 
significantly greater accuracy over a much wider range 
of SNR. 
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